Communication in the Presence of Noise — Probability 
of Error for Two Encoding Schemes 

By S. O. RICE 

Recent work by C. E. Shannon and others has led to an expression for the 
maximum rate at which information can be transmitted in the presence of ran- 
dom noise. Here two encoding schemes are described in which the ideal rate is 
approached when the signal length is increased. Both schemes are based upon 
drawing random numbers from a normal universe, an idea suggested by 
Shannon's observation that in an efficient encoding system the typical signal 
will resemble random noise. In choosing these schemes two requirements were 
kept in mind: (1) the ideal rate must be approached, and (2) the problem of 
computing the probability of error must be tractable. Although both schemes 
meet both requirements, considerable work has been required to put the expres- 
sion for the probability of error into manageable form. 

1. Introduction 

In recent work concerning the theory of communication it has been 
shown that the maximum or ideal rate of signaling which may be achieved 
in the presence of noise is (1, 2, 3, 4, 5) 

Ri=F log 2 (1 + Ws/W N ) bits/sec. (1-1) 

In this expression F is the width of the frequency band used for signaling 
(which we suppose to extend from to F cps), W a is the average signaling 
power and W N the average power of the noise. The noise is assumed to be 
random and to have a constant power spectrum of W N /F watts per cps 
over the frequency band (0, F). 

This ideal rate is achieved only by the most efficient encoding schemes 
in which, as Shannon (1,2) states, the typical signal has many of the prop- 
erties of random noise. Here we shall study two different encoding schemes, 
both of them referring to a bandwidth F and a time interval T. By making 
the product FT large enough the ideal rate of signaling may be approached 
in either case* and we are interested in the probability of error for rates 
of signaling a little below the rate (1-1). The work given here is closely 
associated with Section 7 of Shannon's second paper (2). 

In the first encoding scheme the signal corresponding to a given message 
lasts exactly T seconds, but (because the signal is zero outside this assigned 
interval of duration) the power spectrum of the signal is not exactly zero 
for frequencies exceeding F. In the second encoding scheme, the signal 

* A recent analysis by M. J. E. Golay (Proc. I. R. E., Sept. 1949, p. 1031) indicates 
that the ideal rate of signaling may also be approached by quantized PPM under 
suitable conditions. 
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power spectrum is limited to the band (0, F) but the signal, regarded as a 
function of time, is not exactly zero outside its allotted interval of length T. 
It turns out that both schemes lead to the same mathematical problem 
which may be stated as follows: Given two universes of random numbers 
both distributed normally about zero with standard deviations a and v, 
respectively. Let the first universe be called the a (signal) universe and 
the second the v (noise) universe. Draw 2N -f- 1 numbers ALn, A-n+i, • • • , 
Ao°\ • • • , Aa- 0) at random from the a universe. These 2N + 1 numbers 
may be regarded as the rectangular coordinates of a point P a in 2N + 1- 
dimensional space. Draw 2N + 1 numbers B_ s , ••• , B n , ■ ■ ■ , B N at 
random from the v universe and imagine a (hyper-) sphere S of radius .v " 
= PoQ, where 

.ro = Z B\ = P&\ (1-2) 

n— N 

centered on the point Q whose coordinates are A n + B„, n = — N, • ■ • , 
0, • • • , N. Return to the a universe, draw out A" sets of 2N + 1 numbers 
each, denote thekth set by A*£& % ■■■ , A?\ ■• • , -i.v ' and the associated 
point by Pk- 

What is the probability that none of the A' points l\, ■ ■ ■ , P K lie within 
the sphere S? In other words what is the probability, which will be denoted 
by "Prob. {P t Q, •■■ , P K Q > PoQ)," that the A' distances P X Q, ■•■ , P K Q 
will all exceed the radius P U Q? In terms of the /1,,'s and 2J n 's we ask for 
the probability that all A of the numbers x h x%, ••• , x K exceed .v where 

•r, = t (Air - AT - B n f = P& (1-3) 

» — ti 

Expression (1-2) for x is seen to be a special case of (1-3). The relationship 
between the points P„, Q, Pi, Pi, ■ ■ ■ , Pi., ■ ■ ■ , Pk is indicated in Fig. 1. 
The answer to this problem is given by the rather complicated expression 
(4-12) which, when written out, involves Bessel functions of imaginary 
argument and of order N — 1/2. When N and A become very large the 
work of Section 5 shows that the probability in question is given by 

Prob. (PiQ, ■■■ ,P K Q> PoQ) 

= (1 + erf H)/2 + 0(1/A) + 0{N-** log 3 ' 2 N) (1-4) 

where, with r = v 2 /<t 2 , 
II = Q+_r\' 2 [( N + 1/2) log, (1 + 1/r) - log, (A + 1) 



1 2tN(1 + 2r)l 
2^ (1 + ry J 



(1-5) 
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The symbol 0(N~ lli log 3 ' 2 N) stands for a term of order iV" 1 ' 2 log 3/2 N, i.e., 
a positive constant C and a value No can be found such that the absolute 
value of the term in question is less than CN~~ 1,S log 3 ' 2 N when N > iV . 
In order to obtain actual numerical values for C and No, considerably 
more work than is given here would be required. The term Q(l/K) is of 
the same nature. The "order of" terms have been carried along in the work 
of Section 5 in order to guard against error in the many approximations 
which are made in the derivation of (1-4). 



x^ ' 




IS THE ORIGIN OF COORDINATES 
A*5J,— A^V-A^ OF POINT P k 

IN SPACE IN 2N + 1 DIMENSIONS 



Fig. 1— Diagram indicating relationship between points P , Q, and P k corresponding 
to signal, signal plus noise, and k th signal not sent (k > 0), respectively. 



The last term within the bracket in (1-5) has been retained even though 
it gives terms of order /V - " 2 log N when (1-5) is put in (1-4) and could 
thus be included in 0(yV - " 2 log 3 ' 2 N). As shown by the table in the next 
paragraph, inclusion of this term considerably improves the agreement 
between (1-4) and values of Prob. (P^Q, ■■• , P K Q > P Q) obtained by 
integrating the exact expression (4-12) numerically. This suggests that 
the term 0(A r_1 ' 2 log 3 ' 2 N) in (1-4) is unnecessarily large. 

Although the "order of" terms in (1-4) give us some idea of the accuracy 
of the approximation expressed by (1-4) and (1-5), a better one is desirable. 
With this in mind the lengthy task of computing the exact expression (4-12) 
for Prob. {P\Q, • • • , P K Q > PqQ) by numerical integration was undertaken. 
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The values obtained in this way are listed in the second column of the 
following table. The values of Prob. (PiQ, • • • , P K Q > P Q) obtained 
from (1-4) (in which the "order of" terms are ignored) and (1-5) are given 
in the third column. Column IV lists values obtained from (1-4) and a 
simplified form of (1-5) obtained by omitting the last term in (1-5). These 
values are less accurate than those in the third column. The values in 
Column V are computed from (1-5) and a modified form of (1-4) obtained 
by adding the correction term shown in equation (5-53) (with B = H). 
The values in Column V are presumably the best that can be done with the 
approximations made in Section V of this paper, although the first entry 
renders this a little doubtful. 

Prob. (PiQ, • • • ,PkQ> PoQ) for N = 99.5 & r = 1 

Numerical , _ , „ 

K + 1 Integration (1-4) & (1-5) Col. IV Col. V 

2 ,0 V 30 .994 .9995 .9987 1.0001 

2 ,( V 15 .962 .9650 .9337 .9710 

2 ,0 ° .603 .621 .5000 .605 

2 ,0 Y 5 .1196 .1159 .0663 .1176 

2 1C V° .0065 .00347 .0013 .00586 

It will become apparent later that the value A + 1 = 2 I0U corresponds 
to the ideal rate of signaling. The non-integer value of 99.5 for N is ex- 
plained by the fact that the calculations were started before the present 
version of the theory was worked out. It will be noticed that for A + 1 = 
2 ioo e -3o a u of the approximate values exceed the .994 obtained by numerical 
integration. I am in doubt as to whether the major part of the discrepancy 
is due to errors in numerical integration (due to the considerable difficulty 
encountered) or to errors in the approximations. 

In both encoding schemes, the point P corresponds to the transmitted 
signal, Q to the transmitted signal plus noise, and Pi, Ps, • • • Pk to A 
other possible signals. The average signal power turns out to be (A* + l/2)«r 2 
and the average noise power to be (X + l/2)»/ 2 . Furthermore, 

Xo = twice the average power in the noise. 

Xk — « « " " " " " plus the kW\ signal. 

Prob. (PiQ, ■ ■ ■ PkQ > PoQ) = Probability that none of the K other 

signals will be mistaken for the signal sent, 
i.e., the probability of no error. 

The random numbers A™ are taken to be distributed normally instead 
of some other way because this choice makes the encoding signals (in our 
two schemes) resemble random noise, a condition which seems to be neces- 
sary for efficient encoding (1, 2). 
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Both of the encoding schemes are concerned with sending, in an interval 
of duration T, one of K -\- 1 different messages. According to communica- 
tion theory (1, 2, .1) this corresponds to sending at the rate of T~ l log 2 
(K + 1) bits per second. However, instead of discussing the rate of trans- 
mission, it is more convenient, from the standpoint of (1-4), to deal with 
the total number of bits of information sent in time T. Thus, selecting and 
sending one of the K + 1 possible messages is equivalent to sending 

M = log 2 (A' + 1) (1-6) 

bits of information. M, or one of the adjacent integers if M is not an integer, 
is the number of "yes or no" questions required to select the sent message 
from the K + 1 possible messages (divide the K 4- 1 messages into two 
equal, or nearly equal, groups; select the group containing the sent message 
by asking the person who knows, "Is the sent message in the first group?"; 
proceed in this way until the last subgroup consists of only the sent mes- 
sage). The amount of information which would be sent in time T at the 
ideal rate R { defined by (1-1) is 

Mr - TR, = FT logo (1 -f l/r)= (N + 1/2) log 2 (1 + \/r) (1-7) 

where use has been made of W N /W s = f 2 / " 2 = r, and the relation N < 
FT < N -+- 1 (which turns out to be common to both encoding schemes) 
has been approximated by N + 1/2 = FT. 

When (1-6) and (1-7) are used to eliminate N and K from (1-5) the 
result is an expression for the actual amount M of information sent (in 
time T) in terms of (1) the amount M { which is sent by transmitting at 
the ideal rate (1-1) for a time T, (2) the ratio r of the noise power to the 
signal power, and (3) the probability of no error in sending M bits of in- 
formation in time T, this probability being given as (1 + erf H)/2: 

M = Mi- aM\'-H + b (1-8) 



where 
a = 2 



L(l + r) log. (1 + l/r)J ' 

h l w T 2tt(1 + 2r)M, 1 
*-2 to *L(l + r)Mog a (l + l/r)J 



(1-9) 



Here the "order of" terms in (1-4) have been neglected together with 
similar terms which arise when N + 1/2 is used for A r in computing a and 
b. The term b is usually small compared to aM^fH. 

The more slowly we send, the less chance there is of error. The relation- 
ship between M, Mi and the probability of no error, as computed from 
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(1-8), is shown in the following table. The probability of no error is de- 
noted by p and the terms are given in the same order as on the right of 
(1-8) in order to show their relative importance. The ratio M/M l ( = R/Ri) 
for r = 0.1 is shown as a function of M in Fig. 2. 

For r = Ws/W a = 0.1 
Mi bits M for p = .5 -1/ for p = .99 M for p = .99999 

10 2 Mi-0+ 3.75 Mi - 24.3 + 3.75 M t - 44.6 + 3.75 
10 4 " " + 7.07 " - 243+ 7.07 " - 446 + 7.07 
10« " "+10.38 " -2430+10.38 " -4460+10.38 

For r = Ws/W a = 1 

10 2 M, -0 + 4.44 Mj -33.4+ 4.44 Mj - 61.2 + 4.44 
10 4 u u + 776 « _ 334 + 7-76 " _ 612 + 7.76 

10 6 " "+ 11.08 " - 3340+ 11.08 " - 6120 + 11.08 

There may be some question as to the accuracy of the values for p = .99999, 
especially for M r = 100, since this corresponds to points on the tail of 
the probability distribution where the "order of" terms in (1-4) become 
relatively important. 

Of course, for a given bandwidth, the ideal rate of signaling R T (given by 
(1-1)) for r = .1 exceeds that for r = 1 in the ratio (log 2 ll)/(log 2 2) = 
3.46. 

The above results agree with the statement that, by efficient encoding, 
the rate of signaling R can be made to approach the ideal rate Ri — Mj/T 
given by (1-1). As applied to our two schemes, the term "efficient encoding" 
means using a very large value of FT or N. To see this, divide both sides of 
(1-8) by Mi and rearrange the terms: 

1 - M/Mi = aH M7 1/2 + 0(M7' log Mi) (1-10) 

When Mj is replaced by R r T in M/Mj, the fraction M/T occurs. We shall 
set R = M/T and call R the rate of signaling corresponding to some fixed 
probability of error (which determines H). Thus, when (1-7) and the defini- 
tion (1-9) for a are used, (1-10) goes into 

t - K1 + o^ra + ia) + 0((log FT)/ " T) (W1) 

Equation (1-11) shows that when r and H are fixed (i.e. when the noise 
power/signal power and the probability of error are fixed) R/R r approaches 
unity as FT — > x . This is shown in Fig. 2 for the case r = 0.1. Since R/Ri => 
M/Mi, M/Mj must approach unity and consequently M as well as M T in- 
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creases linearly with FT. Thus, for efficient encoding M is large and, from 
(1-6), so is K. 

It should be remembered that equation (1-8) has been established only 
for the two encoding schemes of this article. The question of how much 
faster M/T approaches Ri for the more efficient encoding schemes mentioned 
at the end of Section 2 still remains unanswered. 



0.9 




0.6 

• ■» _ 2 468, 2 4 6 8 _ 2 4 6 fc , - -, . _ 

10 2 10 3 I0 4 I0 5 10° 

M = BITS OF INFORMATION IN MESSAGE 

Fig. 2 — Curves showing the approach of R/Rj (= M/Mj) to unity as the message 
]englh increases and the probability of no error remains fixed. R is the rate of signaling 
at which the probability of no error is p and Ri is the ideal rate. 



It gives me pleasure to acknowledge the help I have received in the prepa- 
ration of this memorandum from conversations with Messrs. H. Nyquist, 
John Riordan, C. E. Shannon, and M. K. Zinn. I am also indebted to Miss 
M. Darville for computing the tables shown above and for checking a num- 
ber of the equations numerically. 

2. The First Encoding Scheme 

Suppose that we have K + 1 different messages any one of which is to 
be transmitted over a uniform frequency band extending from zero to the 
nominal cut-off frequency F in a time interval of length T. The adjective 
"nominal" is used because the sudden starting and stopping of the signals 
given by the first encoding scheme produces frequency components higher 



COMMUNICATION IN PRESENCE OF NOISE 67 

than F. A shortcoming of this nature must be accepted since it is impos- 
sible to have a signal possessing both finite duration and finite bandwidth. 
The first step of the encoding process is to compute the integer N given 
by 

.V < FT < N + 1 (2-1) 

We assume that FT is not an integer in order to avoid borderline cases. 
Let W s be the average signal power available for transmission and define 
the standard deviation a of the a universe introduced in Section 1 by 
(N + l/2> 2 = W s . To encode the first message, draw 2N + 1 numbers 
A-n, • • • , Ao°\ ■ • • /l.v 0> at random from their universe. The signal correspond- 
ing to the first message is then taken to be 

/„(/) = 2-"'-Ur + 2 (A™ cos 27r;*//r 4- A™ sin 2mt/T) (2-2) 

The remaining A' messages are encoded in the same way, the signal repre- 
senting the k\X\ message being 

/,(/) = r m AP 4- E U? } co&lwni/T + A™ sin 2imt/T). (2-3) 

N = l 

It is apparent that each signal consists of a d-c term plus terms corre- 
sponding to N discrete frequencies, the highest being N/T < F, and that 
the average power (assuming h{t) to flow through a unit resistance) in the 
kt\\ signal is 

r" 1 [ " J it(t) a = 2- 1 uD 2 + f; r\u?Y + U-M (2-4) 

J— r/2 n=l 

Since the ,4's were drawn from a universe of standard deviation a, the ex- 
pected value of the right hand side is (2X -f- \)a-/2 which is equal to the 
average signal power II '*, as required. 

We pick one of the A' + 1 messages at random and send the correspond- 
ing signal over a transmission system subject to noise. We choose our nota- 
tion so that the sent signal is represented by I (l) as given by (2-2). Let the 
noise be given by 

N 

j (I) = 2~ U2 B + 2 &n cos 2vnt/T + B-„ sin Ivnt/T) (2-5) 
n=i 

where B- N , ■ • ■ , B , • • • , B N are (2N + 1) numbers drawn at random from 
the normally distributed v universe mentioned in the introduction. The 
standard deviation v of the universe is given by (N + l/2)v 2 = W N , W N 
being the average noise power. We call J{t) simply "noise" rather than 
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"random noise" to emphasize that (2-5) does not represent a random noise 
current unless N and T approach infinity. 

The input to the receiver is 7 (0 + /(/). Let the process of reception 
consist of computing the K + 1 integrals 

/r/2 
[/*(/) - h(t) - J(t)] 2 dt, k = 0, 1, • ■ • , K (2-6) 
r/2 

and selecting the smallest one (all of the K -\- 1 encodings have been carried 
to the receiver beforehand). If the value of k corresponding to the smallest 
integral happens to be 0, as it will be if the noise /(/) is small, no error is 
made. In any other case the receiver picks out the wrong message. 

When the representations (2-2), (2-3), and (2-5) are put in (2-6) and the 
integrations performed, it is found that 

*k = t Ui W - A? - B n )\ x = t B\ (2-7) 

7i=-iV n=— ,V 

which have already appeared in equations (1-2) and (1-3). If, as in Section 
1, Pic is interpreted as a point in 2X + 1 — dimensional Euclidean space with 
coordinates A-„, ■ ■ ■ , A ( h) , ■ ■ ■ , A$ and Q is the point A-n + B- N , • • • , 
Aq 0) + B , . . . , A£ + Bn, then Xk is the square of the distance between points 
Pic and Q. Point Po corresponds to the signal actually sent, points Pi, • • • , 
P K to the remaining signals, and point Q to the signal plus noise at the 
receiver. The expected distance between the origin and Pk is ir(2N + 1) 1/2 
= (2Wb) 112 , that between P and Q is v{2N + 1) 1/2 = (2W N ) xt \ and that 
between the origin and Q is 

^ + v>yi*(2N + l) 1 ' 2 = (2TF.v + 2W B ) 112 

No error is made when .v is less than every one of Xi, Xi, • • • , Xk, i.e., 
when none of the points P h • • • , P K lies within the sphere S of radius xl' 1 
centered on Q and passing through P . Therefore the probability of obtain- 
ing no error when the first encoding scheme is used is equal to the probability 
denoted by Prob. (PiQ, • ■ ■ , PkQ > PoQ) in the mathematical problem of 
Section 1. 

One might wonder why probability theory has played such a prominent 
part in the encoding scheme just described. It is used because we do not 
know the best method of encoding. In fact, it would not be used if we knew 
how to solve the following problem:* Arrange K -\- I points P , • • • Pk on 
the hyper-surface of the 2.V + 1 — dimensional sphere of radius (2W a ) 112 

* C. E. Shannon has commented that although the solution of this problem leads to a 
good code, it may not be the best possible, i.e., it is not obvious that the code obtained 
in this way is the same as the one obtained by choosing a set of points so as to minimize 
the probability of error (calculated from the given set of points and some given Wy) 
averaged over all AT -f- 1 points. 
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in such a way that the smallestof theK(K + l)/2 distances PkPl, k, t = 0, 1, 
■ • • , K, k 5* I, has the largest possible value. This would maximize the dif- 
ference (as measured by the distance between their representative points) 
between the two (or more) most similar encoding signals. f 

In this paper we have been forced to rely on the randomness of probability 
theory to secure a more or less uniform scattering of the points P 0f - • ■, Pk- 
In our work they do not lie exactly on a sphere of radius (2W S ) 112 but this 
causes us no trouble. 

3. The Second Encoding Scheme 

The second of the two encoding schemes is suggested by one of Shannon's 
(2) proofs of the fundamental result (1-1). In this scheme the K + 1 mes- 
sages are to be sent over a transmission system having a frequency band ex- 
tending from zero to F cycles per second, and are to be sent during a time 
interval of nominal length T. 

The first few steps in the encoding process are just the same as in the first 
scheme. N is still given by (2-1) and <r by (N + l/2)<r 2 = W a . After drawing 
K + 1 sets of A's, with 2N + 1 in each set, the K + 1 messages are 
encoded so that the signal corresponding to the &th message, k = 0, 1, • • •, 
A', is 

/,(/) = (FD 1/2 f A? ^nlT'f ^ 

„=- jV ir\lct — n) 

From (3-1), the value of /*(/) at / = n/(2F) is zero if the integer n exceeds 
N in absolute value. If the integer ;/ is such that | n \ < N, the corresponding 
value of /*(/) is (/•T) 1/ M, ( f ) . The energy in the &th signal is obtained by 
squaring both sides of (3-1) and integrating with respect to /. Thus 

ll{l)dt = 2- l T E AT (3-2) 



/ 



n=—N 



which has the expected value (.Y + l/2)<rT. The average power developed 
when this amount of energy is expended during the nominal signal length 
T is (N + l/2)cr which is equal to W s , as it should be. 

The noise introduced by the transmission system is taken to be 

/(,) = (FT)'" t B. ^f'-f (3-3) 

„ — iV ir{lrt — n) 

t Possibly if K + 1 discrete unit charges of electricity were allowed to move freely 
on the sphere, their mutual repulsion would separate them in the required manner. In 
2N + 1 dimensions this leads to the problem of minimizing the mutual potential energy 

WERT 1 **' 

where N > 1 and the summation extends over k, (= 0, 1, . . . K with k j± (. However, 
this problem also appears to be difficult. 
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where the v universe from which the B's are drawn has, as before, standard 
deviation v given by (N -f l/2> 2 = W N . When the signal /„(/) is sent, the 
input to the receiver is I (l) + /(/) and the process of reception consists of 
selecting the smallest of the K + 1 Xk's 

x t = 2T 1 £ [/*(/) - /„(/) - JO)? d! (3-4) 

= Z (aT - a';' - bS- 

The second expression for Xk is the same as the one given by (2-7) for the 
first encoding scheme, and the discussion in Section 2 following (2-7) may 
also be applied to the second encoding scheme. In particular, the probability 
of obtaining no error in transmitting a signal through noise is the same in 
both systems of encoding, and is given by the Prob. (PiQ, • • • , PkQ > PoQ) 
of the mathematical problem of Section 1. 

4. Solution of the Mathematical Problem 

We shall simplify the work of solving the mathematical problem stated 
in Section 1 by taking a = 1 and v 2 /a 2 = r. First regard the 4N + 2 numbers 
A l n\ B n , n= — A 7 , • • • , A T as fixed or given beforehand. Geometrically, this 
corresponds to having the points P and Q given. Select a typical set of 
random variables An\ n = —N, • • • , N, k > and consider the associated 
set of variables 

y n = A^-AT-B n = A^ + %. (4-1) 

y„ is a random variable distributed normally about its average value 

% = -A™ - B n (4-2) 

with standard deviation tr = 1. The quantity x k , defined by (1-3) and repre- 
senting the square of the distance between Pk and Q, may be written as 

x k = t y\ (4-3) 



i—N 



Thus Xt is the sum of the squares of 2A 7 + 1 independent and normally 
distributed variates, having the same standard deviation but different 
average values. The probability density of such a sum is remarkable in 
that it does not depend upon the y n 's individually but only on the smu of their 
squares which we denote by 

u= £ yl = t U? + B n f 

(4-4) 



_ i |~Energy in sent signal + Energy 
|_in noise 



] 
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This behavior follows from the fact that the probability density of P k has 
spherical symmetry about the origin (because all the Al? h s have the same 
a). For the probability that x k is less than some given value x is the prob- 
ability that Pk lies within a sphere of radius x xl - centered on Q, and this, 
because of the symmetry, depends only on x and the distance u 112 of Q from 
the origin. Accordingly, we write p(x, u)dx for the probability that 
x < Xk < x + dx when the y»'s (and hence u) are fixed. 
The probability density p(x, u) may be obtained from its characteristic 
function: 

p(x,n) = (2tt) _1 f e~ it *[iLve.e i "]dz 

J— 00 

ave. c ,:T = ave. exp iz 2 >'« (4-5) 

L » : — -v - 

= II ave. exp [izy\] = (1 - 2teT N ~ m exp [hiz{\ - 2iz)~ x ] 
wheie we have used (4-3) and, since y„ is distributed normally about y n , 
ave. exp [tzy n \ = (2tt) / e » ay« 

v — 00 

= (1 - 2/=r 1/2 exp [v;^(l - 2/z)- 1 ] 



Hence 

, -Z?-^- 1 [ (i _ 9,>r' v_I/2 pvn r*««f1 - 2;V) _1 - 12*1 rfz 

(4-6) 



p(x,u) =(2 ff )- 1 f" (1 - 2/=r v - I/2 exp[/V»(l - 2/s) ' - izx] dz 

J— 00 

= 2" 1 U-/«)' V/2 " 1/4 / i v-i/2[(«-v) 1/2 ] e - (u+l)/2 

where it is to be understood that .v is never negative. The Bessel function 
of imaginary argument appears when we change the variable of integra- 
tion from s to / by means of 1 — 2/z = 2//.v, and bend the path of integra- 
tion to the left in the / plane (6). This expression for the probability density 
of the sum of the squares of a number of normal variates having the same 
standard deviation but different averages has been given by R. A. Fisher 

We are now in a position to solve the following problem which is somewhat 
simpler than the one stated in Section 1: Given the 2X + 1 coordinates 
An ] of the point P and the 2.V + 1 numbers B n so that the coordinates 
A ( n 0) + B n of the point Q are given. What is the probability that none of the 
K points Pi, Pi, •" t Pk, whose coordinates A 1 ** are drawn at random from 
a universe distributed normally about zero with standard deviation a = 1, 
be inside the sphere centered on the given point Q and passing through the 
other given point A? In other words, what is the probability that all A" of the 



i 
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independent random variables x\, x%, • • • , x K will exceed the given value 
x when u has the value defined by (4-4) together with the given values of 
the A„ 0), s and jB„'s? The variables x h Xt, ••• , x K have the probability 
density p(x, u) shown in (4-6) and .v is defined by (1-2) and the given values 
of the B„'s. 

The answer to the above problem follows at once when we note that the 
probability of any one of x h • • • , x K , say X\ for example, being less than 
x is 

P(xo,u) = f"p(x,u)dx. (4-7) 

Jo 

The probability of xi exceeding xo is then 1 — P(xo, u) and the probability 
of all K of Xi, ■ • ■ , x K exceeding x is 

[1 - P(x , u)] K (4-8) 

Instead of being assigned quantities, x a and u are actually random varia- 
bles when we consider the problem of Section 1. Now we take up the problem 
of finding the probability density of u when .v is fixed. Thus, from (4-4), 
we wish to find the probability density of 

•»- i; ui o) + B n y (4-9) 

r.=— N 

in which the 2N + 1 numbers A n 0) are drawn at random from a universe 
distributed normally about zero with standard deviation a = 1 and the 
numbers B- N , • • • , 2?o, • • • , B N are given. It is seen that u is the sum of 
the squares of IN + 1 normal variates all having the standard deviation 
a = 1. The nth variate, An + B n , has the average value B n . This is just 
the problem which was encountered at the beginning of this section. Equa- 
tion (4-9) is of the same form as (4-3) and we have the following correspond- 
ence: 

Equation (4-3) Equation (4-9) 

Xk U 

y n Air + B n 

y n B n 

The probability that u lies in the interval u, u + du when x is given is there- 
fore p(u, x ) du where />(«, x ) is obtained by putting u for x and Xo for u 
in the probability density p(x, u). 

Until now .r has been fixed. At this stage we regard B- N , • • • , B , ■ • • , B N 
as random variables drawn from a normal universe of average zero and 
standard deviation v = ar xn = r 1/2 . If the standard deviation were unity, 
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the probability density of .v could be obtained directly from p(x, it) by 
letting u — ► in (4-6). As it is, the .v's appearing in the resulting expression 
must be divided by r to obtain the correct expression. Thus, the probability 
of finding .v between .v and .v + dx is 

**> - ^rwy e '""" (4 - 10) 

which is of the x 2 type frequently encountered in statistical theory. 

It follows that the probability of finding u in (u, u + du) and x in 
(.vo, .vn + dxa) at the same time is p (u, x ) du dx where 

po(u, -v ) = p(u, .vo)po(xo) 

1 /".vjY' 2 "'" r Ur ,,^,-w^hoti/. ( 4 " 11) 

= 4rW + l/2)\4r*) '«-"K*>«) 1« 

The replacement of (,v, u) in (4-6) by (u, x ) should be noted. 

Now that we have the probability density of u and x we may combine it 
with the probability (4-8) that all A' of xi, • • • , x K exceed x when x and u 
are fixed. The result is the answer to the problem stated in Section 1 : 

Prob. {l\Q, ••• ,PxQ>PoQ) 

= I du I dx po(u, x )[l — P(x ,u)] K 
Jo Jo 

This result is more complicated than it seems, for p (u, x ) is given by (4-11) 
and P(*oi «) is obtained by integrating p(x, u) of (4-6) from % = to x = x 
in accordance with (4-7). The remaining portion of the paper is concerned 
with obtaining an approximation to (4-12) which holds when N and K are 
very large numbers. 

5. Behavior of Prob. (PiQ, ■■■ , P K Q > PoQ) as N and K Become Large 

In this section we introduce a number of approximations which lead to a 
manageable expression for Prob. (P { Q, ••■ , P K Q > PoQ) when N and K 
become large. 

Since u and .r are sums of independent random variables, namely 

(5-1) 

■vo = 23 B\ , 

n=-.V 

the central limit theorem tells us that the probability density p (u, x ) ap- 
proaches a two-dimensional normal distribution centered on the average 
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values 

u - Z ave.UL 0)2 + Bl\ = (2N + 1)(1 + r) 



(5-2) 
*o = Z ave. 5; = (2JV + l)r 



V 



Here we keep the convention tr = 1, v 2 /<r = r use d m Section 4. The same 
sort of reasoning as used to establish (5-2) shows that the spread about these 
average values is given by 

ave. (« - u) 2 = (42V + 2)(1 + r)- 

ave. (.v„ - xtf = (42V + 2)r 2 (5-3) 

ave. (w - 77) (.To — x ) = (4A r + 2)r- 

If the parameters 2V, K, and r in the integral (4-12) are such that its value 
is appreciably different from zero, most of the contribution comes from the 
region around ii and x n where /> («, .r ) is appreciably different from zero. 
However, instead of taking ft and x o as reference values, we take the nearby 
values 

t h = u-2- 2r= (2N - 1)(1 + r) = 2q(l + r) 

.v 2 = .v„ - 2r = (22V- l) r = 2 9 r 

as these turn out to be better representatives of the center of the distribu- 
tion. We have introduced the number 

q = N - 1/2 (5-5) 

in order to simplify the writing of later equations. We assume q > 1. 
First, we shall show that 

Prob. (PiQ, • • • , PkQ > PoQ) 

f u 2 +a f z 2 +b (5-6) 

= / dll \ dXopoill, .T )[l - P(X , U)\ K + Rl 

Juo —a J x o — & 

where a = 2(1 + r)(2g log q) 1 ' 2 , b = 2r(2q log q) 1 ' 2 and 7?i is of order l/q 
(denoted by 0(l/</)), i.e. a constant C and a value g can be found such that 
| Ri | < C/q when q > q . From (4-12) it is seen that i?i is positive and less 
than 



d« + / du I / dxopo(u, .To) 

+ / rf.v + / </.v / dup (u, .To) 

[_Jo ''12+'' _ •'0 
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Since p (u, .v ) is the joint probability density of u and .r , the integration 
with respect to x in the first part of (5-7) yields the probability density of 
u, and the integration with respect to u in the second part gives the prob- 
ability density p {x ) (stated in (4-10)) of .r . Thus (8) 



I 



. . , [«/2(l + r)]T" /a(,+r) 
axopoyu, Xo) = — ? 



'o '-"■"' 2(l + r)r( ? +l) (5g) 

[V2f]T* 0/2r 



I 



I ^oK-ro)= Trr(9+1) 

Setting (5-8) in (5-7) and putting u = 2(1 + r)y and x = Iry in the two 
parts of (5-7) reduces them to the same form. Thus (5-7) is equal to 

a+t 



2 - 



f y q e-"dy (5-9) 



T(q + 1) 

with I = (2q log q) 1 ' 2 . In order to show that (5-9) is 0(l/q) we use the ex- 
pansion 

-y + q log y = -q + q log q - (y - q) 2 /(2q) + (>- - ?)V(3g 2 ) 

- ()' " 5) 4 9f^ + (v - 3)^/4 

where 0^0^ 1. Let v represent the sum of the (y — qY and (y — q) 4 terms, 
and expand exp v as 1 + v plus a remainder term. The integral of exp — 
U — q y/(2q), taken between the limits q ± t, can be shown to be of the 
form 1 — 0(1/^) by integrating by parts as in obtaining the asymptotic 
expansion for the error function. The term in (y — q) 3 vanishes upon integra- 
tion and the remainder terms may be shown to be of 0(1/^). In all of this 
work a square root of q comes in through the fact that 

1 > (2Tqy'-q q c- q /T(q + 1) > exp [- l/(12g)] (5-10) 

We have just shown that the error introduced by restricting the region of 
integration as indicated by (5-6) introduces an error of order \/q which 
vanishes as q — > » . The normal law approximation to p (u, x ) predicted by 
the central limit theorem holds over this restricted region. However, instead 
of appealing to the central limit theorem to determine the accuracy of the 
approximation, we prefer to deal directly with the functions involved. 

Consideration of (5-4) and the behavior of p (u, .v ) suggests the substitu- 
tion 

*-*&+») (5n) 

u = 2(1 4- r)(q + 0) 
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where a and /? are new variables whose absolute values never exceed 
(2 q log g) 1 ' 2 in the restricted region of integration of (5-6). From (4-11) 

M*,**d du d, = ij-+^ Ql)" 2 I q {^)e-^*+« + » da dfi (5-12) 

in which 

2 = UXo = 4 r(l + r)(q + a)(q + 0) (5-13) 

In Appendix II it is shown that 

r ,J* __ q Q+i/2 e-*z« 2 exp[(q 2 + Z ) 1,2 +V] 

w ; r( ? +i)(^ + z )^ + (? 2 + 2 ) 1/2 ]« l ; 

where | V | < l/(2g — 1) when g > 1. Upon using (5-10) and (5-14) the right 
hand side of (5-12) may be written as 

da d/3(2x)" 1/2 (l + r)(2r)~V + s)" 1 ' 4 exp [- (1 + r)(2q + a + 0) (5-15) 

+ /(z) - log r(g + 1) + 0(1/$)] 

with 

/(z) = g log 2 - q log [g + (g 2 + a) 1 ' 2 ] + (g 2 + s) 1 ' 2 (5-16) 

The value s 2 of z corresponding to the central point (« 2 , %z) of po(u, x ) is 
obtained by putting a = /3 = in (5-13): 

2 2 = 4r(l + r)q 2 

(5-17) 
2 - Z2 = 4r(l + r)[q(a + 0) + a$\. 

Since we are interested in the form of p (u, x ) in the restricted region of 
integration of (5-6) we expand /(z) about z = s 2 in a Taylor's series plus a 
remainder term. 

f(z) = q log 2rq + g(l + 2f) + (z - z 2 )/(4rg) 

(z - s 2 ) 2 (z - 2 2 ) 3 pa + g)'(3f, - g) l (5-18) 

32rV(l + 2r) + " 3! [_ 8z ^3 J 

In the last term z 3 = s 2 + (s — z 2 )0, ^ ^ 1, £5 = g 2 + z 3 . The work of 
obtaining this expansion is simplified if (g 2 + z) 1/2 is replaced by £ in (5-16) 
before differentiating. For example, by using 2£'£ = 1, it can be shown that 
/'(s) is simply (q + £)/(2z). When the extreme values of a and are put in 
(5-17), it is seen that z — z 2 does not exceed 0(g 3/2 log 1 ' 2 q) in the restricted 
region of integration. In the last term of (5-18) z% is 0(g 2 ), £3 is 0(g) and con- 
sequently the last term itself is 0(g~ 1/2 log 3 ' 2 q). 
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When the expression (5-17) for (a — 22) is put in (5-18) an expression for 
f{z) is obtained. This expression, together with 

log T{q + 1) = (g + 1/2) log q - q + (1/2) log 2tt + 0(1/}), 

enables us to write the argument of the exponential function in (5-15) as 
9 log 2r - (1/2) log 2vq - Q(a, 0) + O^ 1 ' 2 log 3 ' 2 ? ) where @(a, 0) denotes 
the quadratic function 

Q(a, 0) = [(1 + r)V + /3 2 ) - 2r(l + r)a0]D 

(5-19) 
Z> = l/[2g(l + 2r)] 

Similar considerations show that 

(jf + z )-a/4 = 5-1/2(1 + 2r)-'/ 2 [l + 0(r 1/2 log 1 ' 2 ?)] (5-20) 

When the above results are gathered together it is found that (5-12) 
may be written as 

p (u, .ro) du dxo = D x exp [-()(«, 0) + 0( 9 ~ 1/2 log 3 ' 2 q)\ da d(3 (5-21) 

where 

* - sjg X r w (5 " 22) 

Expression (5-21) is valid as long as | a | and | j8 | do not exceed 

(2q log q y\ 

Expression (5-21) differs from the one predicted by the central limit 
theorem (and (5-2) and (5-3)) in that it is not quite centered on the average 
values Xn, ft, which correspond to a = 1, /3 = 1, respectively. Also, q enters 
in place of q + 1. However, these differences amount to 0(q 1 '- log 1 ' 2 q) 
at most, as may be seen by putting a — 1 and /3 — 1 for a and /3 in (5-19). 

By using relations (5-6) and (5-21), it may be shown that 

Prob. (PxQ, • • • ,PkQ> PoQ) 

r°° r°° (5-23) 

- I da I 49 A r 0( -»[l - P(.v , «)]* + 0( 9 " 1/2 log 3/2 9 ) 

J— 1} J— c 

where it is understood that .v and u in P(.v , «) depend on a and j3 through 
(5-11). The term 0(q~ 112 log 3 ' 2 q) in (5-23) represents the sum of three con- 
tributions. The first is Ri in (5-6) which is 0(l/q). The second arises from 
the fact that when the factor exp [Q(q~ l,i log 3 ' 2 q)] in (5-21) is neglected in 
integrating (5-21) over - 1 < a < I, -(<&<(, where I = 
(2q log 9) 1 ' 2 , the resulting integral is in error by 0(</ -1/2 log 3 ' 2 q). The third 
is due to the contributions of the integral from the region | a | > t, | | > /. 
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By introducing polar coordinates a = p cos 6, /3 = p sin it can be shown 
that the region p > f more than covers the region in question and that 

Q(a,0)Z {l + r)p 2 D (5-24) 

Upon integrating with respect to p and setting in the lower limit I, it is 
seen that the third contribution is 0(q~ 112 ). 
We now assume A" to be large. Since ^ P(x , u) ^ 1 we have 

<C e~ KP - (1 - P) K ^ KP 2 e~ KP < 1/K (5-25) 

The last inequality follows from x 2 exp (— x) < 1 for * ^ 0. A proof of the 
remaining portions will be found in "Modern Analysis" by Whittaker and 
Watson, Cambridge University Press, Fourth Edition (1927), page 242. 
When we observe that replacing [1 — P(x , u)] h by 1/K in the right hand 
side of (5-23) gives an integral whose value is less than 1/K, we see that 

Prob. (Pi<2, ■■■ ,PkQ> PoQ) (5-26) 

- f da f dp A ,-«<-»-«■<■••■> + 0(1/*) + 0(<f 1/2 log 3/2 q) 

J—q J—q 

We now take up the problem of expressing the cumulative probability 
density P(x a , u) in terms of a and /?. When x and u lie in the restricted re- 
gion of integration shown in (5-6) they are near their average values x Q = 
(2N -f l)r and u = (2N + 1)(1 + r). On the other hand the average value 
x of x and the mean square value al of (.v — x) 2 as computed from (4-6), or 
directly, are 22V 4- 1 + u and 4JV + 2 + 4ti, respectively. Thus we see that 
x — x is of the same magnitude as 4A r and becomes much larger than <r x as 
JV — » oo . The asymptotic development of Appendix I may therefore be used. 
In Appendix / (equations (A 1-2 7) and (A 1-29)) it is shown that when 
M{= 2m = 2N + 1) is a large number and 1 << (x — x )/a x 

P(. Vo> u ) = ^irmh)- 1 ' 2 (1 + 0(l/m)) exp [fnF(»0] (5-27) 

where we have introduced the number m = JV + 1/2 = q + 1 to save writ- 
ing N + 1/2 or q + 1 repeatedly and where 

2h = (1 - 1A'i) 2 (1 + 4rt) 1/2 

*i = [l + (1 + 45/) 1 ' 2 ]/2s (5 2g) 

F( Vl ) = (1 + 4rf) 1/2 - « - / - log vi 

x = 2ms = (2JV + 1)5, u = 2w// = (2 N + 1)/ 

Comparison of the last line in (5-28) with (5-11) shows that ms and ml 
are equal to r(q + a) = r(m + a — 1) and 

(l + r)(? + #- (l + rKm + iS-l), 
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respectively. It is convenient to introduce the notation 

7 = a - 1. 5 = 0-1 

(5-29) 
5 = r (l + 7 / w ), / = (1 -f r)(l + 5/w). 

It is seen that for the restricted region in which | a | and | /3 | are less than 

( = (2q log </) 1/2 , | 7 | and | 5 | are at most 

0( g i/2 iogi/2 q ) = o( m w iogi/2 m ). 

Hence s, I, (1 + %/) 1/2 , «i differ at most from r, 1 • + r, 1 + 2r, 1 + 1/r, 
respectively, by terms of order m~ xl - log 1 ' 2 m. Similar considerations show 
that 

(4tw6 2 )- 1/2 = (27rg) 1 / 2 J D 1 [l + Ofa" 1 ' 2 log 1 ' 2 m)] (5-30) 

The argument of the exponential function in (5-27) must be expanded in 
powers of 7 and 5. It turns out that when 7 and 5 lie in the restricted region, 
powers above the second may be neglected. For the sake of convenience we 
rewrite (5-13) and introduce z\\ 

z = XqU = -im-sl = 4r(l + r)(m + y)(m + 5) 

2] = 4r(l + r)m 2 (5-31) 

3 - z, = -Ml + r)[»(7 + «) + 75] 

so that 3 - si is 0(w 3/2 log 1 ' 2 m). Then 

(1 + 4,/)i/J = (1 + z/m-y-'- 

= (1 + 3,/ro 2 )" 3 + (3 - 3i)(l + si/w 2 )- 1 ' 2 /^/ 2 ) (5-32) 

- (a - 3l ) 2 (l + *i/n?r+n/(M) + R 3 

where i? 2 is of the same order as (z — aO'/w 6 , or m _3/2 log 3 ' 2 m. It follows 
that 



(1 ^ 4 ^ = 1 + 2 , + 2Ki-H-)|T + a , 75 



?K1 + r) r- 

1 + 1r I 



m m- 



(1 + 2r) 3 m- 

_ (1+r) f r [7+5 , 75] 

1,1 r(l + 7/») \ 1 + 2r L « »* 2 J 

_ r ' 2(1 + ^ 7 + *>' + (Km" 3 ' 2 log 3 ' 2 «) 
w 2 (l + 2r)- 



(5-33) 
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Combining these and a similar expression for log Vi leads to 

mF(vi) = - m log (1 + 1/r) + y - 8 

-[(1 + r)y - r8] 2 /[2m(l 4- 2r)] + Oinr 1 ' 2 log 3 ' 2 m) 

(5-34) 
= -(q 4- 1) log (1 + 1/r) 4- a - /3 - [(1 + r> - r/3] 2 P 

+ Ofa" 1 ' 2 log 3 ' 2 ?) 

Substitution of (5-30) and (5-34) in (5-27) gives the result we seek: 

P(x , u) = (1 + \/r)-^{2 n y'W l 

exp (a - j8 - [(1 + r)a - rfflD + O^" 1 ' 2 log 3 ' 2 q)) 

Since P(# , «) occurs only in the product KP(x , u) in (5-26) we set, in 
view of (5-35), 

KP(x 0l u) = A\(a, 0) exp S(a, 13) (5-36) 

where X(a, /3) stands for the terms denoted by exp [0(q~ in log 3 ' 2 q)] in (5-35) 
and 

A = K(l 4- l/r)-«- 1 (2r ? ) 1 / 2 I> 1 

(5-37) 
S( a , 0) = a-p-[(l + r)a- rffiD 

As long as | a j < I and | /3 | < /, A (a, /3) is nearly unity and we write 

Ax < \(a, 13) < A 2 

(5-38) 
Ax = 1 - e, A 2 = 1 + e, e = Cf" 1 ' 2 log 3 ' 2 <Z 

where C is a positive constant large enough to make e dominate the terms 
of order q~ 112 log 3 ' 2 q in (5-35). q is supposed to be so large that e is very small 
in comparison with unity. 
Setting (5-36) in (5-26) gives 

Prob. {PxQ, ■■■ ,PkQ> PoQ) = I + 0(1/A') + 0(r 1/2 log 3 ' 2 q) (5-39) 

where the contribution of the region outside \a\ < I, | /3 j < £ has been 
returned to the terms denoted by 0(q~ 112 log 3 ' 2 q) (we could have stayed in 
the region | a | < I, | /3 | < I from (5-23) onward, but didn't do so because 
we wanted to show that the results coming from (5-25) were not restricted 
to this region) and 

1 = ] da L dl3 Di exp [ ~ G(a ' ^ ~ ^ X(a ' ® e8la ' n] (5_40) 

Let L(\) denote the integral obtained by replacing the function \(<x, 0) in 
/ by the positive constant A (which we shall take to be either Ai or A2 defined 
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by (5-38)). Then, since A exp S(a, 0) is positive, it follows from (5-40) that 

L(Xi) > I > L(X 2 ) (5-41) 

Also since exp [— ^X exp S(a, 0)] lies between and 1 for all real values of 
a and it may be shown from (5-24) that I(X) is equal to /(X) + 0(g^ 1/2 ) 
where 

/(X) = ( da [ d0D l exp[-Q(a,0) - A\e s{a ' P) ] (5-42) 

Here X is a constant and Q(a, 0), A, S(a, (3) are defined by (5-19) and (5-37). 
From (5-39) and (5-41) we obtain 

Prob. (P X Q, ■■■ ,PkQ> PoQ) = /(l) + <?[/(Xi) " /(I)] (5-43) 

+ (1 - 0)[/(X 2 ) - /(l)] + 0(l/K) + 0(^ 1/2 log 3 ' 2 q) 

where < < 1. It will be shown later that /(Xi) and J(X 2 ) differ from 7(1) 
by terms which are certainly not larger than 0(g _1/2 ). 

The problem now is to evaluate the integral (5-42) for J(X). It turns out 
that exp [—A\ exp S(a, 0)] acts somewhat like a discontinuous factor which 
is unity when S(a, 0) + log A\ is negative and zero when it is positive. In 
order to investigate this behavior we make the change of variable 

a — /3 = w a = y — rvo 
(1 + r)a - r0 = y = y - (1 + r)w (5-44) 

da <//3 = dw dy 
From (5-19), (5-37), and (5-42) 

Q(a, 0) = \f + (1 + 2r)p]D = y*D + 0>/2q 

S(a, 0) = w - y°-D (5-45) 

j(\) = f dy J dw D x exp [- fD - (3 2 /2q - A\e w -" 2D ] 

Here and in the following work is to be regarded as a function of w and y. 
Split the interval of integration with respect to w into the two subintervals 
(—w, wo) and (iv , °°) where 

Wo = f-D - log ^X (5-46) 

and y is temporarily regarded as constant. In the first interval 



L 



U>0 

w—w 



exp [-072|7- e w -"°)dw 

(5-47) 
r / " / " ^ - I (1 - exp [- e w - W0 ))c-^ dw 
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Splitting the interval of integration (— °°, w Q ) into (— «, — log .4X) and 
(— log A\, Wo) in the first integral on the right of (5-47) shows that its con- 
tribution to /(X) is 

/» /. — log A\ z* 00 r w o 

dy f dwe- yiD - p2,2q ^D 1 [ dy I dwe^ '^ (5-48) 

m J— co ''-co "—log A\ 

Integrating with respect to y, after inverting the order of integration, shows 
that the value of the first integral is 

x _1/2 f e~ t§ dl = (1 + erf B)/2 (5-49) 

where, from (5-37) and the definition (5-22) of A, 
B = -i(l 4- r ) 1/ V lfl lo S AX 

That the value of /(X) differs from (5-49) by 0(5 -1/2 ) may be seen as 
follows. Since < exp [—j3 2 /2q] < 1, the integral over (wo, °°) (mentioned 
just above (5-46) and obtained by taking the limits of integration to be iv 
and oo in the left side of (5-47)) is positive and less than 

f exp[-e w ~ W0 ]dw = [ e~*dx/x = .219... (5-51) 

Likewise, the second integral on the right side of (5-47) is less than 

/U>0 A 

(1 - exp [- e°- wa ]) dw= / (1 - e x ) dx/x = .796... (5-52) 

Therefore the contribution of the first integral on the right of (5-47) differs 
from /(X) by a quantity less than 

[ A r y2c (.219 + .796) dy = 0(</ _I/2 ) 

•'-co 

in absolute value. The contribution of the first integral on the right of (5-47) 
differs from (5-49) by the second integral in (5-48) which is 0(^ _1/2 ) because 
it is less than 



[ D 1 (y 2 D)e- v!D dy 



The factor (y 2 D) arises from w — (— log /1X) when the mean value theorem 
is applied to the integral in w. Hence J(\) differs from (5-49) by 0(q~ 112 ). 
Although (5-49) is a sufficiently accurate expression of /(X) for our pur- 
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poses, it seems worthwhile to set down approximate expressions for the 
terms which have been dismissed as 0(g~ 112 ). From the above work, 

7(X) = (1 + erf B)/2 + A f dy f v * D if t~ fim exp [ - f"] dw 
e -W\\ - expl-c" - " ])^ 

00 

+ JL/""*} (5-53) 

« (1 + erf B)/2 + A f dy e^ D { -.577.. 4- fD^i 1 * 

= (l + erf5)/2+(^- r )' /2 [-.577..- + 

4-»(l + r)"Ml + (2 + 4r) J B 2 )]r flJ 

where fr = y + (1 + r) log ,4X and we have made use of the fact that 
ff*/2q changes relatively slowly in comparison with w when q is large. 

Since 7(X) differs from (1 + erf B)/2 by 0(?- 1/2 ), and since the three B's 
for X equal to Xi, 1, and X 2 differ by not more than 0(gr»& log (X 2 /Xi)) = 
Ofe" 1 log 3 ' 2 q), from (5-50) and (5-38), it follows that the terms involving 
7(X0 and 7(X 2 ) in (5-43) may be included in the term 0(q- llt log 3 ' 2 q). In 
using our result it is more convenient to deal with N and K + 1 instead of 
q = jv — 1/2 and A". Hence instead of 5 we deal with H defined by 

„ _ 1 (1 + r)' /2 . (JC+lKl + l/r^'d + r) (5 _ 54) 
H ~ ~ 2 (q + 1/2)" 2 10g [2,rfo + 1/2)(1 + 2r)]»« ' 

The difference B - H, with X = 1 and ff finite, may be shown to be (with 
considerable margin) 0(1/ K) + 0(?" 1/2 ). From (5-43), as amended by the 
first sentence in this paragraph, it follows that 

Prob. (PiQ, ■■■ ,PkQ> PoQ) = (1 + erf H)/2 + 0(1/K) + 0(f I/2 log 3 ' 2 q) 

(1-4) 

where the difference between erf B and erf H has been absorbed by the 
"order of" terms. When q + 1/2 is replaced by N in (5-54) the result is ex- 
pression (1-5) for H. 
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APPENDIX I 

Cumulative Distribution Function for a Sum of Squares of Normal 

Variates 

Let x be a random variable defined by 

x = S >i (AM) 

71 = 1 

where y n is a random variable distributed normally about its average value 
y n with unit standard deviation. In writing (A\ — 1) we have been guided 
by (4-3), where M = 2.Y + 1, but here we shall let M be any positive integer. 
In much of the following work M/2 occurs and for convenience we put 

m = M/2 (Al-2) 

From the work of Section 4 it follows that the probability density p(x, u) 
of x is given by Fisher's expression 

p(x, u) = 2- 1 (V«) m/2 - 1/2 /„ 1 -i[M 1 / 2 ]e-<"+* ,/2 (Al-3) 

where u is the constant 

u = E fn (AM) 

n = l 

Here we are interested in the cumulative distribution function, i.e., the 
probability that x is less than some given value x , 

P(xo, u) = I p(x, u) dx (Al-5) 

as M becomes large. In this case the central limit theorem tells us that 
p(x, u) approaches a normal law with average x = M + u an d variance = 
ave. (x — x) 2 = 2M -f- 4«. The function P(.v , «) has been studied by J. I. 
Marcum in some unpublished work, and by P. K. Bose(9). In particular, 
Marcum has used the Gram-Charlier series to obtain values for P(xo, u) in 
the vicinity of x for large values of M. However, since I have not been able 
to find any previous work covering the case of interest here, namely values 
of P(x , u) when x is appreciably less than x, a separate investigation is 
necessary and will be given here. 

Integrating the general expression (4-5) with respect to x between —X 
and x , letting X — » °o , and discarding the portions of the integrand which 
oscillate with infinite rapidity gives 
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P(x , u) = -~ r z-'e-"'" [ave. e i!Z \ dz 

lirl J- M . above 

= 1- ~ [ K z- l e- izi »[we.e izz \dz 

2iri J-oo.iiciowo 



(Al-6) 



where the subscripts "above 0" and "below 0" indicate that the path of 
integration is indented so as to pass above or below, respectively, the pole 
at s = 0. The value of ave. exp (izx) may be obtained by setting N + 1/2 
= m in (4-5). The new notation 

.v = Ms = 2ms, u = 2ml, 2s = f (Al-7) 

enables us to write 

P(x , u) = - ~. ( r 1 exp m[-ist - log (1 - #) 

ZlTl J-oo.abovuO (A 1-8) 

- / + /(l - /f)-'] d$. 

The further change of variable 

1 - /f = v (Al-9) 

carries (Al-8) into 

P(xo,h) = ~ [ (1 - v)' 1 exp [mF(v)] dv (Al-10) 

27T/ Jk 

where the path of integration K is the straight line in the complex v plane 
running from 1 + i'-c to 1 — i-x> with an indentation to the right of v = 1, 
and 

F(v) = sv - log j- + l/v - s - t. (Al-11) 

The K used here should not be confused with the K denoting the number 
of messages in the body of the paper. We have run out of suitable symbols. 
An asymptotic expression for (Al-10) will now be obtained by the method 
of "steepest descents." The saddle points are obtained by setting the 
derivative 



to zero and are at 



F'(v) = s - l/v - t/v°- (Al-12) 

v, = [1+ (1 + \sl)^]/2s 

r 2 = [1 - (1 + Astyi-]/2s (Al-13) 
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As x Q and 5 increase from to co,u and t of course being fixed, we have the 
following behavior: 

x = £ « 

5 = 1 + 1 °° , 

(Al-14) 

Vi = co 1 

V2 m -I -//(l + /) 

[t is seen that ui ^ and v% ^ 0. 

Putting aside for the moment the factor (1 - n) _1 in (Al-10), the path of 
steepest descent through the saddle point V\ is one of the two curves specified 
by equating the imaginary part of F(v) to zero. Introducing polar coordi- 
nates gives 



(Al-15) 



(Al-16) 



v = pe 
Real F(v) = (sp + l/p) cos - log p - s - t 
Imag. F(v) = (sp - t/p) sin 6 - 6 
At vi, 6 = 0, p = v x . Imag. F(vi) = and, from (Al-12), 
Real F(wi) = (2svi - 1) - log v 1 - s - t 
= (1 + 4siyi 2 - log vi - s - i 

The path of steepest descent through vi may be obtained in polar form 
by solving 

(sp - l/p) = 0/sin 6 (Al-17) 

for p as a function of 6. Setting <p = 6 esc 6 and taking the positive value of 
p leads to 

p . y + (^ + 45/) 1 ' 2 ]/25 (Al-18) 

As increases from to ?r, tp increases from 1 to co , and p starts from Vi (as 
it should) and ends at «> . Thus, the path of steepest descent through vi 
comes in from v = — °° + iir/s (whenfl is nearly t, p ttip/s, <p « t/(tt — d) 
and p(?r - 6) « t/s), crosses the positive imaginary v axis and bends down 
to cut the real positive v axis (at right angles) at v h and then goes out to 
v = — co — iir/s along a similar path in the lower part of the plane. It thus 
avoids the branch cut (which we take to run from -co to 0) in the v plane 
necessitated by the term log v in F(v). Since m and 5 are positive the path of 
integration K in (Al-10) may be made to coincide with the path of steepest 
descent when Hi > 1. This corresponds to the case in which .r C x as (Al-14) 
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shows. When < V\ < 1, i.e., » > x Q > x, the two paths may still be made 
to coincide but it is necessary to add the contribution of the pole at v = 1 
as K is pulled over it. This is equivalent to passing from the first to the 
second of equations (Al-6). The path = which makes Imag. F(v) of 
(Al-15) zero turns out to be the curve of "steepest ascent" and hence need 
not be considered. As (Al-13) shows, the saddle point v 2 does not enter into 
our considerations because it lies on the negative real v axis and the path 
of integration K in (Al-10) cannot be made to pass through it without 
trouble from the singularity of F(v) at v = 0. 

We now suppose xo < x so that s and / are such as to make V\ > 1. In 
order to remove the factor (1 — v) from the denominator of the integrand 
in (Al-10), we change the variable of integration from v tow: 

v — 1 = e w , (1 — v)~ l dv = —dw 

(Al-19) 



P(x , u) = - ±-. / exp [»F(1 + e w )\ 



dw 



As v comes in along the path of steepest descent, the path of integration L 
for w comes in from w = » -f- «r and dips down towards the real w axis 
as arg v decreases from ir. L crosses the real w axis perpendicularly at the 
point 

w x = log (»! - 1) (Al-20) 

and then runs out to w = qo — iir along a curve which tends to become 
parallel to the real w axis. W\ may be either positive or negative. When x 
is almost as large as *, w i is large and negative. 

Since F(v) is real along the path of steepest descent, F(l + e w ) is real 
along L. This real value is — °o at the ends of L and attains its maximum 
value F(vi), given by (Al-16), at w = W\. W\ is a saddle point in the complex 
w plane because 

4- F(l + c w ) = F'(l + e w )e w = F'(v)e w (Al-21) 

dw 

vanishes at w = wi. 

Instead of F(l -J- e w ) itself we shall be concerned with 

r - F(l + e 11 ' 1 ) - F(l + O (Al-22) 

so that (Al-19) may be written as 

/>(.,„ „) = - exp [>«F(1 + .-')! t -„ ^ 
In Jl 

The variable r is real on the path of integration L, is zero at w h and in- 
creases to -f- oo as we follow L out tow= °o ± iir. It is convenient to split 
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K into two parts (10). The first part connects °o + Mr to V)\ and the second 
part connects w 1 to » — iw. The values of w on these two parts will be 
denoted by Wi and w n , respectively. Corresponding to each value of r there 
is a value w r and a value w u (in fact it turns out that w n is the conjugate 
complex of wi). Changing the variable of integration in (Al-23) from w to 
t, and remembering that A' starts at oo -f m, gives 

PM . -EW^Ujf .-^ -<*,]* (Al-24) 

Since m is large, most of the contribution to the value of the integral 
comes from around r = or w = w\. In order to obtain an expression for 
the integrand in this region we note that, because F'(vi) = 0, the Taylor 
series for (Al-22) is of the form 

T = -b 2 (w - Mil) 2 - b 3 (w - wi) 3 - b A (w - tc-i) 4 - • • • (Al-25) 

The circle of convergence of this series is centered on W\ and extends out to 
w = ±«r, these points being the nearest singularities of F(l + e w ) as may 
be seen by setting v = 1 + e w in (Al-11) and observing that the singularities 
of log v — t/v in the finite portion of the w plane occur at odd multiples of 
±iir. We imagine the branch cuts associated with log v to run out to the 
right from these points along lines parallel to the real w axis. Since (Al-25) 
has a non-zero radius of convergence, the same is true of the two series ob- 
tained from it by inversion, namely 

Wi — W\ = ibj 1 V " + hr/lbl 

+ i[b7% - Sb?bl/A]r* n /2bT- + • • • 

and the series for w n - o»i obtained from (Al-26) by changing the sign of 
i. Differentiation of these two series gives a series for d(w! — wn)/dT which 
also converges for sufficiently small | r | (putting aside the term in t" 1 ' 2 ), 
and which, when put in (Al-24), leads to 



'lf(l-l) 



P(xo, u) ~ yf^ r , { 1 + ^ \b7\ - 5b?bl/4] + • • • (Al-27) 

That this is an asymptotic expansion holding for large values of m follows 
from a lemma given by Watson (11). The conditions of the lemma hold 
since we have already shown that the series for diwi — w n )/dr converges 
for | t | small enough. Furthermore, d(w 7 — Wj^/dr is bounded for a ^ t 
where t is real and < a ^ the radius of convergence of (Al-26). This 
follows the fact that 



dw _ r<fri _ 

dr \_divj 



[-F'(l + e w )e w Y 
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is bounded except near w = W\ (i.e., r = 0) and, indeed, decreases to zero 
like —e~ w /s as w — ■> oo ± i T (i.e., r — > co). 

The values of ft 2 , 63, h obtained by expanding (Al-22) and comparing 
the result with (Al-25) are 

b 2 = F"(v i )c 2wi /2 

b 3 = [F'"(v 1 )e 3wi + 3F"(v i )e 2,, ' i }/6 (Al-28) 

h = [F""(vy wi + 6F"'(v 1 )e 3wi + 7F"(v 1 )e iv,1 ]/2^ 

F"{ v ) = ir* + 2tv~ 3 , F'"(v) = -2v 3 - 6tv~\ F""{v) = 6*r 4 + 24/ir 5 

Our asymptotic expression for P(x , u), when x < x, is given by (Al-28) 
and (Al-27). Only the leading term of (Al-27) is used in the paper. Some- 
times the following expressions are more convenient than the ones which 
have already been given. 

h = vT\ Vl + 2/) e 2u "/2 - z-7 3 (*i + 2/)(», - l) 2 /2 

= (1 - iAi) 2 (i + Astyiyi (Ai-29) 

F{n) = (1 + 4*/) 1/s - s - t - log vi. 

In all of these formulas vi is given in terms of s and / by (Al-13) and s and 
/ in terms of .To and u by (Al-7). 

When x > x, the saddle point z'i lies between and 1 in the v plane. As 
v follows the path of steepest descent (discussed just below equation (Al-18)) 
arg (v — 1) now stays close to t. From (Al-19) Imag. w stays close to w on 
the new path of steepest descent in the w plane, and the saddle point Wy 
now lies on the negative real portion of the line Imag. w = w. The new path 
starts at w = 00 -f- iir, swings down a little as it comes in, swerves up to 
pass through w^ and then goes out to w = °° + ** above the branch cut 
joining w = iv to w = 00 -j- iir. The analysis goes along much as for v\ > 1 
except that instead of being the imaginary part of u>i is iir. This causes 
the terms in 63 and 64 containing exp (3wi) to change sign. The numerical 
values of b 2 and F(vi) are computed by the formulas (Al-29) as before. The 
fact that b 2 contains the factor exp (ilir) shows up only in changing the sign 
of b-> ' to give the minus sign in the leading term: 

P(xq, u) ~ 1 - (4ttw| & a D" 1 ' 2 exp [mF(vi)] 

which holds for .r > x. The one arises from the pole at v = 1 and is the 
same as the one in the second of equations (Al-6). 

In order to see how (Al-27) breaks down near .v (1 = *, we set x — x = 
2ftt(s — 1 — /) = — 2me or s = 1 + / — e where e is a small positive number 
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Using trl = ave. (x - x) 2 = 4(w + u) = 4w(l + 2/) it is found that 

Vl = 1 + e/(l + 2/) = 1 - 2(*„ - x)al 

mF{v x ) = -me 2 / (2 + 4/) = -(*„ - xY/2<rl 

2mb, = m(vi - 1) 2 (1 + 21) = (x - xj/al 

and that, since w x -* - °o , b 3 -> & 2 and 6 4 -» 76 2 /12. When these values are 
put in (Al-27) the leading term becomes 

P(x , u) ~ (2t)- 1 i*Mz) exp [-2 2 /2<r'] 

and the term within the braces in (Al-27) reduces to 1 — al/z where z = x 
— x > 0. Since the asymptotic expansion is useful only in the region where 
the second term within the braces is small in comparison with the first term, 
which is unity, X — x must be several times as large as a x before we can use 
(Al-27). It will be noticed that the above expression for P(x , u) is closely 
related to the asymptotic expansion of the error function. 

APPENDIX II 

An Approximation for In(x) 

When z in the Bessel function J q (qz) is imaginary a formula given by 
Meissel (12) becomes 

r ( n „\ (gy) g exp (qw + V) ,. 2 ^ 

T " {qy) = e*V{q + 1)^(1 + wY mi) 

where w = (1 + y 2 ) 1/2 and V is a function of y and q which, when q is large, 
has the formal expansion 



= U 2 _2_^, ! \,^ 



V ~ 24? \ 2 »» j + 16? 2 w« 



(A2-2) 



1 f 16+ 1512y 2 - 3654y 4 + 375y 6 \ 

5760 5 3 \ " w 9 J 

Here we shall show that for y ^ and <? > 1 

| V | < 1/(2(7 - 1) (A2-3) 

Consideration of (A2-2) and also of the method used to establish (A2-3) 
indicates that the inequality is very rough. It doubtlessly can be greatly 
improved (but not beyond the 1/(12?) obtained by letting y and q — » <» in 
(A2-2)). Incidentally, it may be shown that the constant terms which re- 
main in (A2-2) when y = °o are associated with the asymptotic expansion 
of log T(q + 1). 
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When (A2-1) is substituted in Bessel's differential equation, which we 

write as 

y £f '.to) + yj y i My) - ? 2 U + y)h(qy) = o, 

we obtain a differential equation for V: 

V" = (4 - y>- 4 /4 - (2^c + w- 2 )y-W - V- (A2-4) 

Here the primes denote differentiation with respect to y. The constants of 
integration associated with (A2-4) are to be chosen so that 

V -> y 2 /(4q + 4) as y -> 0. (A2-5) 

This condition is obtained by comparing the limiting form of (A2-1), in 
which iv — > 1 + y 2 /2, with 



lto) ^r(« + i)L 1+ j+ij i'(«+D P L 



2 2 ~\ 

qy 



4(9 + 1). 

Condition (A2-5) completely determines V since substitution of the 
assumed solution 

V = 4-'(2 + l)-y + ciy 4 + c 2 y 6 + • ■ ■ 

in (A2-4) leads to relations which determine c\, cz, • • • successively. 
Let V = v. Then (A2-4) becomes 

v' = c - 2bv - v 2 (A2-6) 

where c and 6 are known functions of y defined by 

c = (4 - y*)vr*/4, b = (qw + w" 2 /2)y- 1 (A2-7) 

From (A2-5), z> — > y/(2</ + 2) as y — * and therefore 

V = [ vdy (A2-8) 

Jo 

We first show that | v | < l/(2g — 1) when q > 1. The (y, a) plane may 
be divided into regions according to the sign of v'. The equations of the 
dividing lines between these regions are obtained by setting v' = in (A2-6). 
Thus, for a given value of y, v' is positive if v% < v < Vi and negative if 
v > Vi or i> < Vi where 

Vl= - b + (p + C )I/» = C /[ft + (6 2 + C )W2] 

i, 2 = -b + (ft 2 + c) 1 ' 2 (A2-9) 

When y > we have b ^ q. A plot of c versus >> shows that \ c\ ^ 1. Hence, 
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when q > 1, 

6 2 + c } q 2 - i > (e - i) 2 

| ji | < 1/(2? - 1) (A2-10) 

z> 2 < -2 ? + 1 

The curve obtained by plotting v\ as a function of y plays an important 
role because, as we shall show, the maxima and minima of the curve for v 
lie on it. Therefore, the maximum value of | v \ cannot exceed the maximum 
value of \vi\. The maxima and minima must lie on either the Vi or the v 2 
curve since v' vanishes only on these curves. In order to show that it is the 
Vi. curve we note from (A2-9) that, near y = 0, ih behaves like y/(2q +1). 
Consequently both the i<i and v curves start from v = at y = but for a 
while vi lies above v which behaves like y/(2q + 2). Here v lies in a »' > 
region and continues to increase until it intersects vi (as it must do before 
y reaches 2 because vi = at y = 2) at which point v' = 0, vi ^ 0, and v 
has a maximum which is less than the maximum of | v\ \ so v < l/(2q — 1) 
when q > 1. Upon passing through v h v enters a.v' <0 region and decreases 
steadily until it either again intersects the v L curve or else approaches some 
limit as y — > oo . In either case | v \ does not exceed l/(2q — 1), since, in the 
first case v would have a minimum at the intersection and in the second 
j'i — -> as y — > oo . The same reasoning may be applied to the remaining 
points of intersection, if any, of the v and V\ curves. 

In order to obtain an inequality for V itself we rewrite (A2-6) as 

v' = c - (2b + v)v (A2-11) 

The solution of this equation which behaves like y/(2q + 2) as y — > also 
satisfies the relation 

v(y) = jf c(x) exp T-£ [2&(S) + »(£)] «] <fc. 

as may be verified by making use of the relations c(x) — > 1 as x — > and 
2&(£) -» (2? + l)/£, K£) -» f/(2? + 2) as ^ -> 0. For then 

- f [26(^) + v(l-)] dS-+(2q+l) log s/y 

Jx 

v(y) -> f (.Vy) 2,+1 At = y/(2? + 2) 
Hence, from (A2-8) 

I ( yi ) = p dy £ c(x) exp f-£ [2fi(^) + »(£)] ^1 d* 
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and 

I I (ji) | < jT dy jf" | c(x) | exp [- £ [26(f) - | *({) |] dgj <b. 

From 6 £ 9 and | w | < 1/(2? - 1) it follows that 2&(|) - | v(|) | > 2 9 - 1 
when q > 1. This and | c(x) | ^ (4 + a^)(l + ^)~ 2 /4 gives 

I V(yi) \< f dy f (4 + .v 2 )(l + .V')-^- 1 exp [-(2q - l)(y - x)\ dx 
Jo Jo 

5tt 1 



16(2q - 1) 2(/ - 1 

which is the result we set out to establish. The double integral may be 
reduced to a single integral by inverting the order of integration and inte- 
grating with respect to y. Incidentally, most of the roughness of our result 
is due to the use of the inequality for | c(x) |. 
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